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ABSTRACT 

Three procedures of the free- sort methodology which 
are usually standardized were varied in an attempt to discover the 
effects of such variation upon the number and nature of manifest 
categorizations. The conditions investigated were effectiveness of 
the sorting cue, the effects of the order of stimulus presentation 
and the effect of re-sorting. An explicit sorting cue was shown to be 
a highly significant determinant of the number of manifest 
categorizations, but not of the quality or nature of these 
categorizations when compared with an implicit (instructional) 
sorting cue. The effects of differing explicit sorting cues should be 
the object of further study. The effects of stimulus ordering were 
not significant as anticipated, although the treatment means were in 
the predicted order. Subjects encountering initial stimuli which were 
very homogeneous formed more manifest categories (roeans=7.88) than 
did subjects sorting decks with initial-heterogeneous (mean=6.45) or 
completely randomized (mean=6.76) stimuli. Subjects encouraged to 
re-sort their manifest categorizations formed categories which were 
significantly different in nature, but not in number, from the 
categorizations of subjects who were not encouraged to re-sort. In 
addition, there was a significant interaction effect between 
re-sorting and type of sorting cue. (Author) 
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Categorization methodology was developed during |the mid-1960's as 
a* unique procedure for generating and analyzing qualitative information. This 
procedure evolved out of an empirical study of teachers' views regarding the 
facilitation of learning. The study required a methodology which would 
"manifest and explicate teachers' views" by the discrimination of similarities 
and differences between selected content units. Thus, each teacher was 
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required to categorize these content units on the basis of "his own perceptions 
and cognitions regarding the facilitation of learning." This would result in 
a set of categories for each teacher. The problem is then one of identifying 
the underlying commonalities of these individual sorts (Miller et al., 1967, 

p. 98). 

The four stages of the methodology include: 

I Observing and collecting substantive, qualitative data. 

II Summarizing and organizing the elements of the data. 

III Manifesting and explicating the substance and structure of the 
data. 

IV Identifying the latent structure of the substantive manifestations 
(Ibid., p. 175 ). 

A procedure was needed which would allow each teacher (sorter) to 
encounter a content unit, perceive its primary concept, and to categorize it 
in relationship to preceding content units (stage III). This necessitated a 
manipulative task with enough freedom to allow the sorter to apply his own 
substantive meanings. 

Several methods of categorizing content units were tested. One 
method first divided the content units into two gross categorizations and 
then subdivided these categorizations into specific categorizations. This 
method was found to be extremely time consuming and psychologically unsatis- 
factory, since the content units must be manipulated once for each hierarchial 
level of gross and specific categorization. An alternative method would neces- 
sitate a priori sorter specification of a taxonomy of his views of facilitating 
learning. However, prior category definition may bias sorting results since 
content units might be considered only within their fit to the established 
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taxonomy rather than on independent sorter perception of the content unit 
i tsel f . 

The sorting method selected consists of the following major steps: 

1. Read and think about the first content unit. 

2. Decide with what aspect of facilitating learning this content 
unit is concerned. 

3. Write down a tentative statement of that aspect of learning. 

k. Place the content unit in a pocket to begin a category or group. 

5- Take the next content unit and perform steps 1 and 2. If the second 
unit concerns the same aspect of facilitating learning as the first, 
group together the two units. If the second unit concerns a dif- 
ferent aspect of learning, perform steps 3 and 

6. Repeat steps 1 through 5 for each content unit (ibid., p. 99). 

Pilot testing indicated the need for three additional steps: 

7* Re-sort at any time during steps 1 to 6 when a unit is encountered 

which does not belong where it was previously placed. The re-sort 

may involve: 

a. placing a unit in another group, 

b. starting a new group, or 

c. mixing it with the units not yet sorted. 

8. Review the groups carefully after completion of steps 1 to 6. 

Review the ideas of each grouping with special concern for whether 

the units belong together. Changes may be made by dividing, combining, 
or switching the statements. If in doubt, begin a new category. 

9. Check after sorting all units to see that a word or short phrase has 
been written (on each category index card) which gives the central 
idea explaining why the units were grouped (ibid., p. lOO). 

No directions were given to the sorter as to the number of categories 
they could form, or the number of content units which could be placed within 
a given category. The sorter was free to establish and define his own categori- 
zations. Thus, this method has become known as the free-sorting, or F-sort, 
techniques (Miller et al., 1969). 
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The data obtained from the F-sort is then analyzed in stage IV by 
any one of several available procedures (see Haenn, 1971). Most of these 
analyses have been based on the model of Latent Partition Analysis (LPA) 
developed by Wiley (1967) and computer programmed by Wolfe (I 967 ). (For an 
excellent discussion of LPA and a review of related procedures, see Gross, 

1970.) 

A typical F-sort consists of the following parts. There is a 
presentation, and numerous reminders, of a sorting cue during the task in- 
struction period. The sorters are then allowed an unlimited amount of time 
to sort the randomly-ordered, but homogeneous, stimuli (content units) into 
categories of their own choosing. The subjects are allowed to re-sort the 
stimuli as often as they wish, and are sometimes asked to title their mani- 
fested categories, but there is no external pacing. The function of the 
sorting cue, the homogeneity of the stimuli, and the re-sorting components 
are the subject of study in the present report. Other variables, such as 
number of stimuli (content units), time allowed for administration, number 
of sorters, and the like, will be left for other investigators. 

Sorting cue . The directions for the sorting procedure which are 
administered prior to the actual sorting period will contain some implicit, 
operational discrimination criterion to the sorter, such as "sort those 
stimuli together which you feel should be together." However, the typical 
experiment also contains an explicit substantive criterion, such as "form 
groups indicating your Ideas as to the kinds of things a teacher does with 
respect to facilitating learning of elementary/secondary school students" 
(Miller et al., 1969* p. ^3)* This latter type of discrimination criterion. 
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known as a sorting cue, sets a definite standard for sorting (here, it 
Is for sorting according to stimulus similarity pertaining to the facili- 
tation of learning), while the former type of sorting cue is instructional, 
but allows the sorter to set his own criterion. Such cues fit a type ^ 
instruction, one that provides information of a substantive type, such as 
a sorting principle (Kiausmeier and Meinke, 1968). 

Homogeneity of stimuli . Stimuli are usually randomly punched and 
printed on IBM cards for ease of analysis through a computer procedure. Thus, 
each deck of stimuli is prepared in such a way that every sorter has an equal 
probability of being presented each possible stimulus ordering. This has 
been done to eliminate the effects of stimulus ordering and stimulus per- 
severation on the categorization procedure. 

Re-sorting . After each stimulus has been encountered and categorized, 
subjects are encouraged to re-sort their categorizations. Such re-sorting Is 
expected to provide a check on the homogeneity of each categorization. This 
is consistent with the design of the sorting procedure to promote the evolution 
and induction of categories, rather than deduction. 

Statement of the Problem 

The recency of the development of categorization methodology 
has precluded any extensive research into the effects of variation in 
normal administration procedures. This is especially true of the 
F-sort technique, which has developed a standardized set procedures for 
administration. Effects of elimination or variation in the sorting cue. 
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homogeneity of initially-encountered stimuli and absence of re-sorting 
may have profound effects on the outcomes of free-sorts. Variations in 
these conditions will form the hypotheses of the study. 

Hypotheses 

1. There will be no differences on measures of sorting 
behavior between subjects receiving an explicit, sub- 
stantive sorting cue and subjects receiving an implicit, 
operational sorting cue. 

Verbal instructions about task procedures or solution cues 
have been found to have a facilitating effect on performance during 
problem-solving learning (Wittrock et al., 1964), especially if used 
In a repetitive or confirmatory manner (Wakai , 1967). Knowledge of a 
principle or cue also facilitates performance better than knowledge of 
problem structure (Klausmeier and Meinke, 1968). However, arousal reduces 
effective utilization of cues (Eas terbrook , 1959). 

Haenn (1968) found no differences between utilization of task 
instructions and instructions containing a solution cue in a learning 
set formation study with preschool children. Children required to cate- 
gorize objects on their own did as well or better than children given 
extensive cues, although their categorizations were more relational and 
utilized more obvious, sensed stimulus characteristics than the more 
analytical categorizations of children receiving cues (Edwards, I 969 ) . 

In both studies, instructed subjects performed better than their control 
counterparts . 

These contradictory results give little evidence pertaining to 
the present investigation. It Is hypothesized that sorting differences 
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on this given stimulus sample will be due to inherent characterlstcs of 
the stimuli themselves and, therefore, an explicit sorting cue of this 
type will do little to intensify these characteristic differences. 

If the data fail to confirm this hypothesis, the effect of 
stronger and differential sorting cues should then be tested in later 
experimentation. 

2. The homogeneity of initially-encountered stimuli will 
result in different numbers and types of manifest 
categor i zat ions . 

In their original study. Miller et a1. (196?) stated: 

. . . presentation of the units (stimuli) according to their 
consecutive numbering was likely to influence a sorter's con- 
struction of categories. As this ordering effect could not 
be studied in detail, the possibility of Its occurrence was 
counter-balanced by randomization of content units (stimuli) 

This randomization minimized any artifacts due to primacy 
or recency effects (p. \0k) . 

Also, they stated elsewhere: 

. . . there are certainly differences between tiie information 
processing of the first item and of succeeding items. The 
experimental procedure attempted to skirt such questions by 
randomizing the order of the content unit stimuli (p. 111). 

Since the nature of stimuli provides a major cue concerning 

the expected range of the judgment scale (Upshaw, 1970), stimuli presented 

early in the deck will probably have a greater effect on the total range 

within which later stimuli will be sorted. This adjustment of the scale 

of judgment to stimuli is known by many names, but Johnson and Mullally 

( 1969 ) suggest the term "context effect," as each stimulus is judged in 

the context of already sorted stimuli. Upshaw (1970) believes that most 

people are aware of context effects at an early age. 

The range of stimuli should also determine the size of the 

sorter's judgmental unit (Upshaw, 1970), especially when there is a finite 
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population of stimuli to be sorted. Upshaw (1970) states: 

. . . when judging with a relatively large unit (heterogeneous) 
item), a subject sets his perspective at a position which is 
more extreme in either direction (has a higher probability of 
being placed into a distinct category) than is the case when 
he judges with a relatively small unit (p. I 33 ). 

Conry (1970) has been conducting exploratory research on the 
"mix of item characteristics" (homogeneity of the sorting stimuli) and 
the type of sorting item (snow crystals or verbs). He has discovered an 
interaction effect between the mix and item sorting type, suggesting 
that not only stimulus presentation itself, but also the type of stimulus 
influences the sorting procedure. (For a review of the types of stimuli 
thus far explored, see Haenn, 1971.) 

The free-sorting outcomes are summarizations of all manifest 
sorts (called S matrices) which represent the proportion of sorters who 
categorize each pair of stimuli together in the same manifest category. 
These S matrices then become the input for Wiley's ( 1967 ) Latent Parti- 
tion Analys is, or LPA. 

It has been demonstrated that just a simple variation in one 
of these standardized sorting procedures (presenting ini tial ly-homogeneous 
or Ini tial ly-hete.rogeneous stimuli) can greatly affect the average number 
of manifest categories sorted by each group (Haenn, 1971). Since an S 
matrix is based on joint proportions and the total item set is fixed, 
fluctuations in the average number of manifest categories will be reflected 
throughout the LPA procedure. 

Thus, the beginning stimuli encountered by a sorter delimit the 
range of later categorizations. If the initially-encountered stimuli 
are very homogeneous, sorters should tend to make finer discriminations 
and, on the average, form more manifest categories. Subjects encountering 
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I nl t i a 1 ly-heterogeneous stimuli should make more gross discriminations 
and form manifest categorizations of a type more closely aligned with the 
latent categories previously determined by statistical procedures of 
other sorts. Subjects receiving completely-randomized decks should form 
manifest categorizations somewhere between these extremes. 

3. The re-sorting procedure affects the type, but does not 
affect the number of final manifest categorizations. 

Re-sorting was added after some initial pilot testing in the 
Miller et al . (I 967 ) study . . to provide an opportunity for sorters 
to review the composition of their categories . . . (p. 105)." Its 
function was ". . . to ensure that content units (stimuli) were homo- 
geneously grouped and not necessarily to provide opportunity for exten- 
sive restructuring or redefinition of categories (p. IO 6 )." 

Re-sorting should tend to eliminate a chaining effect, whereby 
the last stimulus sorted into a category is only remotely related to the 
first stimulus of that category. Several excellent studies have been 
conducted which explored the relationship between free-sorting, associ- 
ational and chaining procedures (Johnson, Ashton, Deken, and Robb, 1970; 
Johnson et al., 1970b). However, the effects of re-sorting on the 
quality of conceptual categorizing have not yet been examined. 

Re-sorting usually occurs after all stimuli have been encountered 
Since it is hypothesized that intial ly-encountered stimuli delimit the 
range of categorization, the function of re-sorting should be primarily 
to tighten this structure by relegating ambiguous stimuli to more relevant 
manifest categories. Subjects who re-sort their manifest categories 
should then have final manifest categorizations which are more similar to 
the underlying latent structure. 

9 
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METHOD 



Subjects 

The subjects of this study v^ere twelfth-grade, male students 
drawn from two 1500-student senior high schools located within the same 
school district. This school district encompasses predominantly white, 
middle class communities of approximately 60,000 residents in the 
suburbs of a large midwestern city. 

These high school subjects have everyday exposure to teachers who 
are attempting to facilitate learning in the classroom. Their twelve 
years of schooling experience should make them aptly suited for the stimuli 
to be utilized in the free-sort procedure. The results of their sorts 
could be compared with the already obtained results from teacher trainees 
and experienced elementary and secondary school teachers. 

The subjects were selected from senior physical education classes. 
One hundred twenty-five subjects completed all phases of testing. They 
ranged in age from 17“2 to 19“9 years of age, with a mean of 18-0.8 years 
and a standard deviation of 5-507 months. 

Variables 

Five variables were investigated in the study. One of these 
variables was intended to be intelligence. However, intelligence measures 
were not available within this school district and a performance measure 
was chosen instead. Performance and age comprise the independent variables 
and three measures of sorting behavi''*' were used as the dependent variables. 
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Sort! ng sti mul i . The F~sort was completed by each subject 
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utilizing a refinement of the fifty teacher verbs used in later portions 
of the Wisconsin study (Miller et al., I 967 ). The earlier sorting stimuli 
for the Wisconsin study had been classroom content units. These were in 
the form of sentences describing teacher behaviors. However, the nature 
and number of stimuli required very long sorting times and necessitated 
quite small sample sizes. 

The problem was one of devising a set of content units which 
were easy to sort but still would be useful in a study of teachers' per- 
ceptions of classroom learning. Present tense, third person verbs were 
selected which described definite classroom actions. After some pretesting, 
a final set of fifty verbs was selected. 

The refinement of the fifty verbs by the present study attempted 
to further eliminate ambiguities in the latent category structure. The 
original data from one of the most popularized of the Wisconsin sub-studies- 
the elementary and secondary teacher study (Miller et al., I 967 ; 1969) — was 
secured and analyzed by Latent Partition Analysis (LPA) . 



Insert Table 1 about here 

The I matrix in Table 1 gives the verb composition of the latent 
categories for all 703 sorters based upon a ten-category solution. A dual 
criterion was established based on evaluation of the loading a verb received 
within the latent category into which it was placed and the difference 
between this loading and the highest non- latent category loading. The first 
measure estimates the relative strength of the item within a given category 
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Table 1 

i - lO-CATEGORY SOLUTION TO 50-VERB S-MATRIX 



Original 

Number 


Verb 


1 


2 


3 


it 


5 


6. 


7 


8 


9 


10 


11 


Demonstrates 


101 


-2 


-2 


2 


-3 


-1 


1 


1 


3 


1 


21 


1 1 lust rates 


97 


-0 


1 


1 


-it 


-0 


10 


-2 


-1 


-0 


13 


Displays 


95 


-2 


2 


it 


3 


-2 


-2 


-0 


3 


it 




Threatens 


-1 


1 10 


3 


-2 


2 


-1 


1 


-lit 


-5 


3 


29 


Penal i zes 


-1 


1-5 


5 


2 


1 


-2 


it 


-5 


-10 


-1 


39 


Reprimands 


-1 


100 


it 


-2 


1 


-2 


6 


it 


-8 


-2 


10 


Demands 


-3 


79 


-12 


1 


-0 


it 


-9 


5 


2it 


10 


i»0 


Restricts 


3 


75 


-5 


-2 


-3 


-it 


-1 


it it 


-6 


-1 


22 


Impels 


-5 


73 


-1 


-1 


1 


-0 


-11 


-11 


itO 


16 


6 


Commends 


3 


2 


110 


6 


1 


lit 


8 


8 


-15 


-35 


23 


1 nspi res 


-1 


-0 


106 


-8 


1 


-16 


-18 


-12 


10 


37 


15 


Encourages 


-8 


-6 


106 


-6 


-1 


-it 


-5 


-1 


lit 


12 


k5 


Stimulates 


3 


0 


98 


-8 


-1 


-16 


-13 


-11 


6 


it3 


k2 


Rewards 


6 


lit 


95 


20 


1 


18 


9 


1 


-20 


-it it 


20 


Grades 


3 


1 


-2 


lOit 


1 


it 


-10 


-it 


5 


-2 


^7 


Tests 


3 


- -2 


-2 


102 


0 


10 


-13 


-3 


0 


6 


17 


Evaluates 


-0 


-6 


10 


97 


1 


-13 


15 


it 


-8 


0 


26 


Judges 


0 


6 


-6 


90 


-2 


-8 


5 


6 


9 


-1 


32 


Plans 


0 


2 


8 


0 


103 


-1 


1 


-5 


-8 


1 


28 


Organizes 


2 


1 


2 


-2 


102 


-it 


11 


-2 


-1 


-8 


3 


Arranges 


-1 


1 


-2 


-1 


98 


-2 


10 


0 


3 


-6 


^3 


Schedules 


-5 


-1 


-8 


3 


97 


2 


-13 


7 


6 


8 


38 


Repeats 


-2 


-3 


-8 


-7 


-0 


118 


lit 


-6 


2 


-8 


i»l 


Reviews 


-3 


1 


2 


5 


1 


108 


2 


-13 


-13 


12 


li» 


Drills 


1 


3 


-15 


3 


-7 


105 


-3it 


-2 


6 


39 


36 


Reinforces 


it 


-1 


iti 


-2 


3 


89 


23 


-1 


-16 


-itO 


37 


Reminds 


-2 


-it 


0 


-5 


0 


72 


6 


23 


36 


-2it 


^9 


Tutors 


2 


-17 


-1 


-it 


-it 


itO 


-5 


30 


10 


39 


5 


Clarifies 


2 


1 


-5 


-6 


it 


6 


1 1 1 


-3 


-6 


-it 


it it 


Simplifies 


8 


1 


-10 


-7 


8 


12 


97 


-it 


3 


-9 


2it 


1 nterprets 


-it 


1 


-8 


10 


-0 


-15 


87 


-0 


3 


27 


19 


Explai ns 


21 


3 


-6 


-7 


-0 


-6 


76 


-0 


-6 


29 


3it 


Reasons 


-lit 


-0 


3 


-3 


-1 


-17 


62 


2 


31 


36 


7 


Conf 1 rms 


-8 


-5 


18 


9 


3 


27 


57 


7 


19 


-28 


18 


Exempl i f ies 


39 


-2 


13 


-1 


1 


-it 


it it 


it 


lit 


-10 
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Table 1 (continued) 



Original 
Number Verb 


1 


2 


3 


A 


5 


6 


7 


8 


9 


10 


35 


Regulates 


-1 


0 


-12 


-0 


-2 


-6 


-2 


123 


1 


-3 


8 


Controls 


6 


lA 


-7 


-0 


-5 


-3 


-3 


119 


-5 


-11 


kS 


Supervises 


-6 


-30 


3 


3 


7 


-3 


-5 


107 


-5 


29 


30 


Perml ts 


-3 


0 


39 


-A 


-5 


-6 


12 


80 


-5 


-10 


16 


Enforces 


8 


A2 


3 


1 


-5 


21 


5 


5^ 


-1 


-2A 


1 


Advises 


-11 


-26 


25 


-3 


-1 


-10 


17 


A8 


31 


26 


31 


Persuades 


A 


-2 


-1 


2 


-1 


-1 


-5 


-3 


118 


-8 


9 


Convinces 


3 


-3 


-lA 


3 


1 


-3 


1^» 


-2 


107 


-6 


50 


Urges 


-A 


3 


38 


-1 


-2 


2 


-lA 


-6 


81 


6 


12 


Dl scusses 


2 


3 


12 


-9 


-11 


-9 


36 


3 


-18 


93 


33 


Ques t ions 


-25 


7 


13 


20 . 


-11 


5 


25 


-6 


-18 


93 


27 


Lectures 


A2 


5 


-1^» 


-3 


-2 


20 


-35 


5 


5 


77 


25 


1 ntroduces 


3^ 


A 


18 


-7 


19 


-0 


-19 


-5 


-11 


70 


k 


Assigns 


-5 


-A 


-13 


A 


33 


29 


-37 


20 


7 


67 


2 


Answers 


-22 


6 


-8 


13 


-5 


21 


A8 


-8 


1 


57 



NOTE: Each entry Is multiplied by 100 for ease In reading. 



based on the structure, while the second measure estimates the confusion of 
the item with any other latent category. The number of verbs falling within 
given cells of a matrix of these criterion is given in Table 2. Based on 



Insert Table 2 about here 



a dual criterion eliminating all verbs having both a loading less than 0.60 
and a non-latent category entry within 0.25 of the latent category loading, 
the following verbs were eliminated in a series of analyses: (1) advises, 

(2) answers, (i») assigns, (7) Confirms, (12) discusses, (16) enforces, 

(18) exemplifies, (33) questions, (3^) reasons and (^9) tutors. 





Table 2 



Highest 

Latent 

Category 

Loading 



50-VERB MATRIX OF CRITERIA FOR A lO-CATEGORY SOLUTION 

Highest Non-Latent Category Loading 





O 


Ln 


O 


in 


O 


Ln 


O 


Ln 


o 


Ln 


Number of 


Ln 






m 


rn 


cs 


CV4 


-• 




o 


Verbs 




\ 




\ 


\ 














3 


3 


3 


3 


3 


3 


3 


5 


3 


3 


Loadings ^ .85 


16 


15 


13 


11 


7 


5 


5 


it 


3 


2 


Loadings 5.80 


15 


lit 


13 


11 


7 


5 


5 


it 


3 


2 


Loadings <.75 


12 


12 


12 


10 


7 


5 


5 


it 


3 


2 


Loadings <.70 


9 


9 


9 


8 


7 


5 


5 


it 


3 


2 


Loadings <.65 


7 


7 


7 


7 


7 


5 


5 


it 


3 


2 


Loadings 5.60 


6 


6 


6 


6 


6 


5 


5 


it 


3 


2 


Loadings <.55 




it 


it 


it 


it 


it 


it . 


3 


2 


2 


Loadi ngs <.. 50 


3 


3 


3 


3 


3 


3 


3 


2 


2 


2 


Loadings 5.^5 


2 


2 


2 


2 


2 


2 


2 


2 


2 


2 


Loadings 5.^0 


1 


1 


1 


1 


1 


1 


1 


1 


1 


1 
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An analysis of the resulting l»0"item S-matrix produced the f 
matrix given in Table 3. The matrix of criteria (Table h) shows that this 
solution is extremely well structured, having no loadings less than .60 and 



Insert Tables 3 and k about here 

no non-latent category entries within 0.25. In fact, the lowest loadings 
are above .70 with no non-latent category loadings within 0.35. The 
remaining items, listed in Table 5, were selected as the stimuli for 
sorting in this study. 



Insert Table 5 about here 



Measures of Sorting Ability 

Three measures of sorting ability were computed for each subject. 

These are: 

1. Number of manifest categories. 

2. Prototypic Discordance score. 

3. Conceptual Disparity score. 

There has been a definite need for obtaining methods of scoring 
individual categorization behavior "...which accurately reflect quality of 
conceptual categorization, as well as the number of categories" (Sloane, 
Gorlow and Jackson, 1963, p. 1|02) . Prototypic Discordance (PD) has been 
presented as one such method (Miller et al., I 967 ). It was designed to 
measure the ". . . extent to which the composition of a sorter's categories 
differed from the composition of the latent partition (p. 125)." PD is 




15 



16 



Table 3 

$ - 9-CATEGORY SOLUTION TO AO-VERB S-MATRIX 



Original New 

No. No. Verb 123^56789 



11 


7 


13 


8 


21 


1 A 


27 


20 


25 


18 


A 8 


39 


29 


22 


39 


30 


10 


6 


22 


15 


AO 


31 


6 


3 


A 2 


33 


23 


16 


15 


10 


A 5 


36 


20 


13 


A 7 


38 


17 


11 


26 


19 


32 


25 


28 


21 


A 3 


3 A 


3 


1 


38 


29 


A 1 


32 


1 A 


9 


36 


27 


37 


28 


9 


5 


31 


2 A 


50 


AO 



Demonstrates 
Displays 
1 1 lustrates 
Lectures 
I ntroduces 

Threatens 

Penal i zes 

Reprimands 

Demands 

Impels 

Restricts 

Commends 
Rewards 
I nspi res 
Encourages 
Stimulates 

Grades 

Tests 

Evaluates 

Judges 

Plans 

Organizes 

Schedules 

Arranges 

Repeats 
Rev i ews 
Drills 
Reinforces 
Reminds 

Convinces 

Persuades 

Urges 



no 


-1 


-0 


107 


-0 


A 


105 


-0 


2 


85 


3 


-17 


68 


0 


13 


-0 


111 


3 


-1 


107 


6 


-2 


102 


6 


2 


82 


-13 


1 


76 


-A 


A 


75 


-A 


-8 


2 


110 


-9 


15 


105 


13 


-A 


98 


-3 


-8 


98 


20 


-A 


93 


0 


1 


-1 


A 


-2 


-1 


-2 


-5 


10 


-3 


7 


-5 


1 


1 


6 


-1 


0 


2 


-2 


-0 


-8 


-5 


1 


-1 


-7 


-2 


-6 


2 


-0 


1 


20 


1 


-16 


-10 


1 


A 3 


-13 


-3 


A 


0 


-6 


-16 


-3 


-3 


2 


-A 


2 


35 



-1 


-7 


-2 


1 


-1 


-3 


-2 


-7 


-1 


2 


5 


21 


-1 


2 A 


1 


-1 


1 


-1 


2 


0 


-2 


-2 


-0 


-1 


2 


1 


A 


0 


3 


1 


-2 


-A 


-3 


2 


-3 


11 


lA 


-A 


15 


-5 


5 


-13 


-5 


1 


-5 


-A 


3 


-20 


103 


1 


A 


101 


1 


10 


97 


0 


-9 


91 


-3 


-7 


0 


lOA 


1 


-2 


103 


-2 


A 


100 


3 


-1 


99 


-1 


-6 


-1 


106 


6 


3 


lOA 


6 


-1 


101 


-5 


-0 


80 


-7 


-1 


69 


3 


-0 


-0 


0 


-2 


1 


-1 


-0 


2 



-2 


2 


3 


-A 


-0 


-6 


-5 


-0 


9 


10 


A 


-16 


-2 


-A 


2 


-7 


-10 


2 


-12 


-A 


A 


-10 


A 


A 


2 A 


3 


-5 


A 3 


-12 


-5 


-6 


A 1 


-1 


-16 


8 


-6 


-32 


2 


-8 


21 


-12 


1 


21 


-2 


3 


17 


-11 


7 


2 


-3 


-8 


0 


-3 


-9 


-6 


3 


13 


8 


5 


7 


-7 


-A 


-2 


-2 


-1 


6 


5 


5 


-10 


1 


2 


7 


2 


-2 


17 


-9 


-10 


5 


9 


-0 


-22 


-17 


-1 


8 


31 


21 


0 


107 


2 


9 


106 


3 


-3 


79 


-5 


-7 



NOTE: Each entry is multiplied by 100 for ease in reading. 
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Table 3 (continued) 



Original 

No. 


New 

No. 


Verb 


1 


2 


3 


k 


5 


6 


7 


8 


9 


35 


26 


Regulates 


-3 


-5 


-10 


-0 


1 




5 


117 


1 


8 


k 


Controls 


3 


]k 


-k 


-1 


-5 


-1 


-3 


105 


-5 




37 


Supe rvi ses 


8 


-25 


5 


6 


13 


3 


0 


85 


k 


30 


23 


Permi ts 


-k 


-1 


i»0 


-5 


-6 


-2 


-1 


72 


k 


5 


2 


Clarifies 


-6 


1 


2 


-3 


-1 


6 


-3 


-0 


104 


kk 


35 


Simplifies 


-9 


k 


-3 


-5 


3 


7 


2 


-3 


104 


2k 


17 


Interprets 


3 


-2 


-k 


15 


-2 


-11 


9 


3 


88 


19 


12 


Explains 


31 


1 


-2 


-3 


-2 


-3 


-1 


2 


78 



NOTE; Each entry is multiplied by 100 for ease in reading. 
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AO-VERB MATRIX OF CRITERIA FOR A 9-CATEGORY SOLUTION 
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Highest 

Latent 

Category 

Loading 



Highest Non-Latent Category Loading 



Number of 
Verbs 


w/i .50 


ITS 

- 4 - 


0 


w/l .35 


0 


tn 

CM 


w/l .20 


Ln 

5 


w/i .10 


w/i .05 


Loadings ^ .85 


8 


7 


5 


3 


0 


1 

0 1 


1 

1 0 


0 


0 


0 


Loadings ^ .80 


8 


7 


5 


3 


0 


1 

1 

0 , 0 


0 


0 


0 


Loadings ^.75 






3 


2 


0 


1 

0 [ 0 


0 


0 


0 


Loadings ^.70 


2 


2 


1 


0 


0 


1 

0 1 0 


0 


0 


0 


Loadings ^.65 


0 


0 


0 


0 


0 


1 

1 

0 t 0 


0 


0 


0 


Loadings ^.60 


0 


0 


0 


0 


0 


.. i| 

1 

0 • 0 


0 


0 


0 


Loadings ^.55 


0 


0 


0 


0 


0 


0 




0 


0 


0 


Loadings ^.50 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


Loadings ^.^5 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


Loadings 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 
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Table 5 



LIST OF SELECTED TEACHER VERBS 



1 


Arranges 




21 


Organizes 


2 


Clarifies 




22 


Penal i zes 


3 


Commends 




23 


Permi ts 


it 


Controls 




2it 


Persuades 


5 


Convinces 




25 


Plans 


6 


Demands 




26 


Regulates 


7 


Demonstrates 




27 


Reinforces 


8 


Displays 




28 


Remi nds 


9 


Drills 




29 


Repeats 


10 


Encourages 




30 


Reprimands 


11 


Evaluates 




31 


Restricts 


12 


Explains 




32 


Rev i ews 


13 


Grades 




33 


Rewards 


lit 


1 1 lustrates 




3^ 


Schedules 


15 


impels 




35 


Simplifies 


16 


1 nspires 




36 


Stimulates 


17 


Interprets 


% 


37 


Supervises 


18 


Introduces 




38 


Tests 


19 


Judges 




39 


Threatens 


20 


Lectures 




itO 


Urges 
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computed separately" for each subject using both the S-matrix for the total 
group and the S-matrix for the individual. Prototypic Discordance is 
defined as the sum of the squares of the element-by-element differences 
between the total group (or specified sub-group) S-matrix and the individ- 
ual's S-matrix. In mathematical notation this would be represented as: 



PD = E E(..th element of the S matrix for the total 
1>J '-^..th element of the S matrix for a given 



sample - 
subject) ^ . 



O 

ERIC 



The S matrix is the symmetric joint proportion matrix indicating 
the probability that any two items were sorted together. Thus, larger PD 
weights will be obtained for poorer sorts and indicate a lack of concor- 
dance with other sorters. 

A second measure has been proposed by the author and is considered 
as an exploratory measure in this discussion. The Conceptual Disparity 
(CD) score is also based on the sample population S matrix, but considers 
the latent category ($) matrix in addition. 

The equations consist of two stages. In stage one, a standardizing 
coefficient (CD*) is derived from the S and $ matrices by: 



A 


= S • $ 


, where NS = number of stimuli, and 


NSxNLC 


NSxNS NSxNLC 


NLC = number of latent categories 


K 


* A XX $ 


, a Haddamard multiplication. 


NSxNLC 


NSxNLC NSxNLC 






NS NLC 




CD* 


= 1 IK,. 

i-i M 'J 





In stage two, the Conceptual Disparity (CD) score is computed from 
the sample joint pro^;ortion (S) matrix, the matrix of manifest partitioning 
for a given subject (Zj) and the standardizing coefficient (CD*) by 
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A = S • Zi , where NMC = number of manifest categories. 

NSxNMC NSxNS NSxNMC 

K = A XX Zj 

NSxNMC NSxNMC NSxNMC 

NS NMC 

CD = i ( CD* -( E E Kj ;)) 

1=1 j=l ^ 

In each stage, the joint proportion (S) matrix Is post-multiplied 
by either the latent category ($) or manifest partition (Zj) matrix and then 
this product Is Haddamard multiplied (element-by-element multiplication) by 
these same matrices to produce a matrix K. This K matrix Is simply a Joint 
proportion (S) matrix which has been re~sca1ed by either the latent category 
( 4 ) matrix or the manifest partition (Z|). The elements of the K matrix are 
then summed and subtracted from the standardizing coefficient to give CD. 

Thus, we arrive at a score which estimates the degree of disparity 
for a given manifest sort from the underlying latent structure. In addition, 
the sign of the score may indicate whether the number of manifest categories 
is greater than, or less than, the number of underlying latent categories. 

In a pilot computation four latent categories were assumed as the 
underlying latent structure for seven stimulus items. For all manifest 
partitions with at least one more (less) category than the number of latent 
categories, the computed CD's were positive (negative). It is hoped that 
an underlying latent structure with more latent categories and based on a 
larger number of stimulus items will produce even clearer results. 

The computational values of CD contain information not only about 
the type, but also about the number of manifest partitions. This statistic 
is limited only in the extreme cases where all NS stimuli are sorted into 
either 1 category or NS categories, for which there is no solution. 
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Procedure 

Age otid pcrformiincc measures were obtained from school records. 

The performance records consisted of American College Test (ACT) compre- 
hensive scores and Iowa Test of Educational Development (ITEO) quantitative 
thinking, correctness of expression and composite scores. However, not all 
information was available for all subjects, and for some subjects there 
was no information at all available. Therefore, the ACT score was selected 
as the measure of interest. For those subjects who had only ITED scores, 
a regression analysis was used to determine an appropriate ACT score. For 
those subjects with no scores, classroom means were used. Means had to be 
used for less than 13 per cent and regressions for less than l8 per cent 
of the total classroom populations. 

Special instructions were prepared for each class appropriate 
to one set of treatment conditions. This required the construction of 
four sets of instructions: explicit sorting cue subjects; explicit 

sorting cue subjects who were encouraged to re-sort; implicit sorting 
cue subjects; and, implicit sorting cue subjects who were encouraged to 
re-sort. Types of initially-encountered stimuli could be randomly 
varied within each classroom. 

Subjects were tested during their regular physical education 
activity periods. Sorting times varied within each classroom, but all 
subjects completed the task within one class period and at one sitting. 

The design of the study is a complete factorial design with two 
levels of .sorting cue (implicit vs. explicit sorting cue), three types of 
stimulus presentation (ini tial -homogeneous , initial-heterogeneous, and 
completely- random! zed stimulus decks), and two re-sorting effects (re-sorting 
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vs. no re-sorting). This research design is presented in Table 6. 



Insert Table 6 about here 



Classrooms at the first school were randomly assigned to sorting 
cue and re-sorting treatments. All subjects were randomly assigned to 
stimulus-presentation treatments. Four classrooms at the first school were 
sampled so that each cell would contain at least ten subjects. However, 
due to the nature of physical education scheduling, some classrooms did not 
have the expected thirty students. Therefore, students from one classroom 
at the second school were selected and randomly assigned to those ceils with 
smaller numbers of subjects. Cell #12, which is identical to the standard 
procedure, was the control ceil. 

The Implicit sorting cue treatment (iSC) received only task- 
orienting instructions — "sort those verbs together which you feel should be 
together." Subjects in the explicit sorting cue treatment (ESC) received 
the explicit sorting cue — "sort these verbs according to your views of 
facilitating learning in the classroom" — several times in different permu- 
tations in addition to the task-orienting instructions. Ail subjects were 

> 

given general instructions concerning the physical nature of the task. 

Subjects in the initial-homogeneous stimuli treatment (IHO) 
received stimulus decks in which the stimuli were randomized within their 
latent categories, which were also randomized (see Figure 1). Subjects in 



Insert Figure 1 about here 
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Latent category n 



Latent category 02 



Latent 
category n^ 




/ 



Verbs randomly assigned within category n; 




/ 



Verbs randomly assigned within category n? 




Verbs randomly assigned within category n^ 











Figure i . 



idomization of the homogeneous (IHO) decks, where 
, n2f**>i^j randomly assigned numbers of 
ch latent category. 
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the Ini tial -heterogeneous stimuli treatment (IHE) received stimulus decks 
which presented the verbs with the highest probability within each latent 
category (keywords) first, followed by verbs of decreasing probabilities, 
with latent categories randomized (see Figure 2). Subjects in the 



Insert Figure 2 about here 



completely- random! zed stimuli treatment (CRS) received stimulus decks in 
which all stimuli were completely randomized, regardless of the latent 
categories. This randomization and the punched stimulus cards were completed 
by computer procedures. 

The re-sort (R) treatment was given instructions which strongly 
encouraged the sorter to re-sort his manifest categorizations. The no re- 
sort (nr) treatment had instructions which did not prevent stimulus re-sorting, 
but In no way encouraged such re-sorting. Rather, these subjects were en- 
couraged to stay with their first categorizations. 



Analysis 

The results passed through a three-stage analysis. During stage 
one, LPA was utilized to obtain the underlying latent categorization of the 
total sample. Then, number of manifest categories, the Prototypic Discor- 
dance score and the Conceptual Disparity score were computed for each 
subject. These sorting behavior measures became the input for stage two, 
where Pearson product-moment correlations were computed among all variables. 
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Verb with the lowest probability 
within each latent category 



Category n; verb 

/ / / : 

Category n? verb 
Category m verb 




Verbs with the next highest probability 
within each latent category 



Category nj verb 



/ / / / 



Category n2 verb 
Category m verb 



Verb with the highest probability 
within each category — keyword 



Category nt verb 

/ / / / / 



Category n<j verb 
Category n^ verb 




Figure 2. Randomization of the heterogeneous (IHE) decks, where 

n^, n 2 »<<<<nj are the randomly assigned numbers of each 
latent category. 
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The third stage was a multivariate analysis of covariance 
using the IBM 360/65 MESA98 Multivariate Analysis program with the three 
measures of sorting behavior as dependent variables and the age and 
performance measures as covariates. Each of the three treatment factors 
and their interactions were examined for post factum hypotheses to be 
tested at a later time. 



RESULTS AND DISCUSSION 

General Findings 

The results of univariate analyses of the data by cell are 
presented in Table 7* The number of subjects per cell was either 



Insert Table 7 about here 



10 or 11 for all cells except cells 11 and 12, which had 9 and 12 
subjects, respectively. The independent variables, age (in months) 
and ACT score (performance measure), differ little among the cells. 
Number of categories ranges from a mean of 5*33 for cell 12 to 9. 91 
for cell 1. Prototypic Discordance (PD) scores range from a mean of 
85.77 for cell k to 151.98 for cell 11. Finally, Conceptual Disparity 
(CD) scores range from a mean of -20.7^ for cell 11 to -2.22 for cell 6. 

The results by treatment conditions (combinations of these 
cells) are much more readily interpretable. Table 8 shows that there is 
also little difference among treatments on the independent variables. 

Insert Table 8 about here 
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However, there do appear to be large differences on all three dependent 
variables on the presentation of stimuli and type of sorting cue treat- 
ments. The re-sort results do not appear to be substantially different. 

The relationships between variables are explored In Table 9. 

Age and performance measures are correlated with each other but unrelated 



Insert Table 9 about here 



to the dependent variables. Indeed, In a regression analysis neither 
Independent variable accounted for more than 1.3% of the variance on 
any given dependent variable. The multiple R squared values were only 
.088 for number of categories, .123 for Prototyplc Discordance scores 
and .081 for Conceptual Disparity scores. Thus, neither of these In- 
dependent variables accounted for very much variance In the model. 

Number of categories relates positively to Conceptual Disparity 
score (e.g. the more manifest categories formed, the higher the CD score), 
but negatively to Prototyplc Discordance score (e.g., the fewer manifest 
categories formed, the higher the PD score). Theoretically, CD scores 
should be uncorrelated with number of categories. But the number of 
latent categories Is considerably higher than the average number of 
manifest categories (9 vs. 7*03). Thus, a large number of CD scores 
were negative Indicative of this lower average number of manifest 
categories, which In turn led to the large positive correlation. Also, 
a low PD score indicates close correspondence to the average sort. The 
correlation between PD and number of categories closely approximates that 
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p<.05 

:p< .01 



33 

found by Miller et al. (1967) in several of their sub-studies, except 
for the inverse relationship. 

Hypothesis 1 

it was hypothesized that there would be no difference between 
subjects receiving explicit or implicit sorting cues on the three depen- 
dent measures. However, the univariate tests of this hypothesis were 
significant for number of categories (F=7-75, p<.006) but not for Conceptual 
Disparity scores (F=3.19* P<.076) or Prototypic Discordance scores (F<1). 

This highly significant result indicates that sorting cue had 
a potent influence upon the number of categories formed, but not on 
their type. This is especially significant since the most ambiguous 
stimuli were eliminated before sorting began, leaving a highly structured 
set of stimuli. Thus, the explicit sorting cue utilized appears to be 
more important than the inherent characteristics of the stimuli in forming 
the number of categories. 

Hypothesis 2 

It was hypothesized that the homogeneity of the initially- 
encountered stimuli would affect both the number and the type of manifest 
categorizations. Although the F-ratios for number of categories and 
Prototypic Discordance scores showed some effect, they were not statisti- 
cally significant (p<.l85 and p<.199, respectively). The F-ratio for 
Conceptual Disparity scores did not approach one. 

These findings contradict the previous results (see Haenn, 1971) • 
However, the ordering of means conformed to expectation. Subjects 
receiving homogeneous stimuli early in the sort tended to make more manifest 
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categories (mean=7.88) than subjects sorting i ni tial -heterogeneous 
(mean=6.^5) or completely randomized (mean=6.76) stimuli. This ordering 
of means was exactly as predicted, with the completely randomized stimuli 
mean closer to the mean for i ni tial -heterogeneous stimuli. A Helmert 
contrast of the difference between initial homogeneous stimuli and the 
mean of the other two groups supports this contention, although the 
contrast was not significant (F=3.30, p<.072). 

Both the i ni tial -homogeneous and initial-heterogeneous means are 
lower than those reported in the previous study. However, this is due in 
a large part to the reduced number of stimuli (50 vs. ^0 teacher verbs). 
Apparently, number of verbs sorted is an important factor influencing 
total number of categories formed. In fact, number of categories may 
even be age-related, since Miller's (1967) teacher-trai ni ng seniors 
averaged only 6.3 categories before and 7*5 categories after a ten-week 
practice teaching period while experienced teachers (average age = 38.8 
years) formed 10.0 categories. However, another, more important factor 
may be the amount of teaching experience. 

Thus, although the trends do support this hypothesis, number 
and type of manifest categorizations do not appear to be significantly 
affected by order of stiit'ilus presentation. 

Hypothesis 3 

It was hypothesized that re-sorting would affect the type, but 
not the number of final manifest categorizations. However, all F-ratios 
for this hypothesis are less than unity and only the latter condition 
appears to be true. These finding may be the result of the experimental 
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conditions themselves, since no subjects were prohibited from re-sorting. 
Only the Re-sort subjects were encouraged to re-sort their initial mani- 
fest categorizations. 

However, the No Re-sort group took more time to complete their 
sorts ( 18 . 3 ^ vs. 1^.78 min.), suggesting that their initial categoriza- 
tions were completed more cautiously or that they re-sorted as they pro- 
ceeded. The results were re-analyzed, covarying sorting time. If the 
effect of sorting time is eliminated, Prototypic Discordance scores are 
significantly different (F=^.22, p<.0^2) as are Conceptual Disparity 
scores (F=5.12, p<.026) but number of manifest categories (F<1) is not 
significant. Thus, subjects encouraged to re-sort their manifest categor 
izations had significantly lower CD and PD scores, although this did 
not affect the number of categories formed. Thus, this hypothesis is 
supported. 

Analysis of Interaction Effects 

No interaction effects were hypothesized, but all were examined 
for post factum hypotheses. The only interaction effect to emerge was 
between sorting cue and re-sorting when sorting time is covaried. Number 

of manifest categories (F=5-26, p<.02^) and Prototypic Discordance scores 
(F=6.6^, p<.011) were both significant and Conceptual Disparity scores 
approached significance (F=3*?2, p<.056). The estimated combined means 
showed that subjects receiving an explicit sorting cue but who were not 
encouraged to re-sort, formed fewer manifest categories and these 
categories were more highly discrepant as reflected by high PD and low 
CD scores. 
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SUMMARY 

Three procedures of the free-sort methodology which are 
usually standardized were varied in an attempt to discover the effects 
of such variation upon the number and nature of manifest categorizations. 
The conditions investigated were effectiveness of the sorting cue, the 
effects of the order of stimulus presentation and the effect of re-sorting. 

An explicit sorting cue was shown to be a highly significant 
determinant of the number of manifest categorizations, but not of the 
quality or nature of these categorizations when compared with an implicit 
(instructional) sorting cue. The effects of differing explicit sorting 
cues should be the object of further study. 

The effects of stimulus ordering were not significant as anti- 
cipated, although the treatment means were in the predicted order. 

Subjects encountering initial stimuli which were very homogeneous 
formed more manifest categories (mean=7-88) than did subjects sorting 
decks with initial-heterogeneous (mean=6.^5) or completely randomized 
(mean=6.76) stimuli. 

Subjects encouraged to re-sort their manifest categorizations 
formed categories which were significantly different in nature, but 
not in number, from the categorizations of subjects who were not 
encouraged to re-sort. In addition, there was a significant interaction 
effect between re-sorting and type of sorting cue. 



O 

ERIC 



36 



37 



REFERENCES 



Allen, Thomas W. and John M. Whitelay, Dimensions of Effective Counseling . 
Columbus, Ohio: Charles E. MerriTl, 1968. 

Bersted, Chris T., Bill R. Brown and Selby H. Evans. Free sorting with 

stimuli clustered in a multidimensional attribute space. Perception 
and Psychophysics . 6(6B) , ^09"^13, 1969. 

Bruner, Jerome and Henri Tajfel. Cognitive risk and environmental change. 

Journal of Abnormal and Social Psychology , 62: 231-2^1, 1961. 

Conry, Robert F. Personal communication. December, 1970. 

Cronbach, Lee J. Response sets and test validity. Educational and Psycho- 
logical Measurement, 6: ^75"^9^, 19^6. 

• Further evidence on response sets and test design. Educational and 

Psychological Measurement , 10: 3"31, 1950. 

Easterbrook, J.A. The effect of emotion on cue utilization and the 

organization of behavior. Psychological Review , 66(3); 183"201, 1959. 

Edwards, Joseph C. Effect of instruction and concomitant variables on 

multiple-categorization ability. Journal of Educational Psychology , 

60(2): 138-li»3, 1969 . 

Gross, Susan K. Lack of fit and group comparisons in Latent Partition 

Analysis. Unpublished Ph. D. Dissertation, University of Chicago, 1970 

Haenn, Joseph F. The effects of verbal instructions and corrections upon 

learning set formation in preschool children. Unpublished M.S. thesis, 
Bucknell University, I 968 . 

Haenn, Joseph F. Categorization methodology; applications and directions. Paper 
presented at the annual meetings of AERA, New York: February, 1971* 

Johnson, Donald M. and Carolyn R. Mullally. Correlation-and-regression 

model for category judgments. Psychological Review , 76 ( 2 ): '205"215, 1969- 

Johnson, Thomas J., Patricia Ashton, Joseph G. Deken and Richard Robb, Cog- 
nitive and associative structure in economics. Paper presented 
at the annual meetings of the AERA. Minneapolis, Minnestoa: March, 

1970 a (mimeo). Revised, January, 1971* 




a? 






Johnson, Thomas J., Norbert Kerr, Gerald Miller, Adrian P. VanMondrans 
and Alan Kamil. Some characteristics of conceptual chaining. 

St. Ann, Missouri: Central Midwestern Regional Educational Labora- 

tory, November, 1970b (mimeo). 

Klausmeier, Herbert J. and Dean L. Meinke. Concept attainment as a 

function of instructions concerning the stimulus material, a strategy, 
and a principle for securing information. Journal of Educational 
Psychology , 59(3): 215-222, 1968. 

Klein, George S. Need and regulation. In Jones, M.R. (Ed.). Nebraska 

Symposium on Motivation . Lincoln: University of Nebraska Press, 195^* 

. Cognitive control and motivation. In Lindzey, Gardner (Ed.). 

Assessment of Human Motives. New York: Holt, Rinehart and Winston, 

iw: 

Messick, Samuel and Ferdinand Fritzky. Dimensions of analytic attitude in 
cognition and personality. Princeton, New Jersey: Educational Testing 

Service, research bulletin 63“2, February, 1963. 

Miller, Donald M. Elementary school teachers' viewpoints of 

classroom teaching and learning. Madison, Wisconsin: University of 

Wisconsin, Instructional Research Laboratory. Final Report, USOE, 
Project /'5-1015— 12-1 , I 967 . 

Miller, Donald M., David E, Wiley, Richard G. Wolfe and Robert F. Conry. 
Categorization methodology: an approach to the collection and 
analysis of certain classes of qualitative information. Madison, 
Wisconsin: University of Wisconsin, Instructional Research Laboratory, 

Technical Report #2018, 1969. 

Olmsted, Patricia P., Carolyn V. Parks and Annette Rickel. The development 
of classification skills in the preschool child. Internationa l 
Review of Education . 16(1): 67“79» 1970. 

Sloane, Howard N., Leon Gorlow and Douglas N. Jackson. Cognitive styles 

in equivalence range. Perceptual and Motor Skills , I6: 389-^OA, I963. 

Tajfel, Henri, Alan Richardson and Louis Everstine. Individual consisten- 
cies in categorizing: a study of judgmental behavior. Journal of 

Personal i ty . 32(1): 90-109, 196Aa. 

. Individual judgment consistencies in conditions of risk taking. 

Journal of Personality , 32: 550-565, 196Ab. 

Thurstone, L. L. A factorial study of perception. Chicago: University of 

Chicago Press, Psychometric Monograph ifk, 19^^. 



O 

ERIC 



38 



30 



Upshaw, Harry S. The effect of unit size on the range of the reference 

scale. Journal of Experimental Social Psychology, 6: 129-139, 1970. 

Wachtel, Paul L. Style and capacity in analytic functioning. Journal of 
Personal i ty . 36: 202-212, 1968. 

Wakai , Kunio. Effects of verbal instructions in problemsolving. 

Japanese Journal of Educational Psychology , 15: 27-33, I 967 . 

Wiley, David E. Latent Partition Analysis. Psychometr ika, 32(2): 183-193. 

1967. 

Wittrock, Merlin C., Evan R. Keislar and Carolyn Stern. Verbal cues in 

concept identification. Journal of Educational Psychology. 55: 195-200. 

196 ^ 4 . ^ 

Wolfe, Richard G. Program CESSIO. - Unpublished computer documention, 1967* 





